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9.1.2 Maximum A Posteriori (MAP) Estimation 

The posterior distribution, fx\Y ( or Px\Y{ x \y))’ contains all the knowledge about 
the u nkn own quantity X. Therefore, we can use the posterior distribution to find point or 
interval estimates of X. One way to obtain a point estimate is to choose the value of X that 
maximizes the posterior PDF (or PMF). This is called the maximum a posteriori (MAP) 
estimation. 
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Figure 9.3 - The maximum a posteriori (MAP) estimate of X given Y — y is 
the value of X that maximizes the posterior PDF or PMF. The MAP estimate of 

X is usually shown by XmAP- 


Maximum A Posteriori ( MAP ) Estimation 


The MAP estimate of the random variable X , given that we have observed Y — y, is given 
by the value of x that maximizes 

fx\Y{ x \y ) if X is a continuous random variable, 

Px\y{ x \ y) if X is a discrete random variable. 

A 

The MAP estimate is shown by XmAP- 

To find the MAP estimate, we need to find the value of X that maximizes 

fY\x(y\ x )fx(x) 

fy(y) 

Note that /v(i/) does not depend on the value of X. Therefore, we can equivalently find the 
value of X that maximizes 


fx\Y( x \y) 


fY\x(y\ x )fx ( x )• 

This can simplify finding the MAP estimate significantly, because finding fy{y) might be 
complicated. More specifically, finding /v(y) usually is done using the law of total 
probability, which involves integration or summation, such as the one in Example 9.3 . 
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To find the MAP estimate of X given that we have observed Y = y, we find the value of X 
that maximizes 


fy\x(y\ x )fx(x). 

If either X or Y is discrete, we replace its PDF in the above expression by the corresponding 
PMF. 


Example 9.4 

Let X be a continuous random variable with the following PDF: 


fx(x) 


2x if 0 < x < 1 

0 otherwise 


Also, suppose that 

Y | X — x ~ Geometric(x). 
Find the MAP estimate of X given Y — 3. 

• Solution 

o We know that Y | X = x ~ Geometric(x), so 


Py\x(y\ x ) = x(l- x) y 1 , for y = 1 , 2 , 


Therefore, 

Py\x(3\x) — x(l — x) 2 . 

We need to find the value of X G [0,1] that maximizes 

PY\x(y\x)fx(x) = x(l - xf • 2x 
— 2x 2 (1 — x) 2 . 

We can find the maximizing value by differentiation. We obtain 

d 


dec 


x 2 {l — x)‘ 


— 2x{l — x) 2 — 2(1 — x)x 2 — 0. 


Solving for X (and checking for maximization criteria), we obtain the MAP 
estimate as 
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